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1.  ABSTRACT 


Successful  airspace  eontrol  is  one  of  the  key  faetors  maximizing  the  effeetiveness  of  air 
operations.  It  includes  long  and  short-term  planning  and  control  that  utilizes  large  and  dynamie 
databases,  and  eonstitutes  a  eombination  of  resource  alloeation,  routing,  scheduling,  and 
deeonflietion  tasks  performed  repeatedly  refleeting  the  battlefield  dynamies.  These  tasks  plaee 
heavy  burden  on  personnel,  leading  to  eostly  ineffieiencies.  Modern  eomputing  teehnologies  are 
eapable  of  expanding  the  share  of  airspaee  eontrol  functions  performed  by  eomputers  resulting  in 
numerieally  justified  deeisions  that  will  enhanee  planning  and  reduee  pressure  on  its  personnel 
without  freeing  them  from  the  ultimate  responsibility.  The  resultant  problem  is  to  be  deeomposed 
and  its  particular  subsets  are  obtained  in  a  deeentralized,  but  eoordinated  fashion.  This  approaeh 
is  best  served  by  the  “multi-agent”  system  teehnology  that  has  been  sueeessfully  deployed  as  the 
eomputational  engine  behind  the  airspace  control  system.  The  resultant  software  tool  features  the 
distributed  eoordination  meehanisms  based  on  oolleetive  deeision-making  and  knowledge 
sharing,  agent  arehiteeture  and  speeifie  agents  responsible  for  data  oolleetion/updating  and 
planning/soheduling/deoonfiiotion  tasks,  and  the  required  visualization  teehnology.  It  has  been 
validated  by  a  eomprehensive  ease  study. 
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2,  OVERVIEW 


Successful  airspace  eontrol  is  one  of  the  key  faetors  maximizing  the  effeetiveness  of  air 
operations  and  the  entire  combat  operation.  It  ineludes  long  and  short-term  planning  and 
seheduling,  and  real-time  eontrol.  These  funetions  utilize  a  large  and  dynamic  database  and 
eonstitute  a  very  eomplex  eombination  of  resouree  alloeation,  spaee  alloeation,  routing, 
seheduling,  deeonflietion,  and  eontrol  tasks  that  are  to  be  solved  under  information  uneertainty 
and  rigid  time  eonstraint.  These  tasks  must  be  performed  periodieally  to  aeeommodate  for  the 
eontinuously  arriving  new  information  refleeting  the  dynamics  of  the  battlefield  operation.  The 
Airspaee  Control  Authority  (ACA)  has  highly  trained  personnel  utilizing  their  knowledge, 
experienee,  and  intuition  to  perform  all  neeessary  ACA  funetions.  However,  the  eomplexity  of 
the  tasks,  large  volumes  of  data  to  be  analyzed  and  stringent  time  requirements,  plaee  a  heavy 
burden  on  individual  planners  that  eombined  with  the  entire  scope  of  issues  labeled  as  “human 
faetor,”  may  adversely  affeet  the  quality  and  timeliness  of  ACA  deeisions.  Consequently,  these 
eould  be  among  the  faetors  limiting  the  sueeess  of  the  air  eampaign  and  preventing  advaneed 
military  equipment  and  personnel  to  utilize  their  potential  to  the  fullest.  Availability  of  modern 
eomputing  teehnologies  ereates  the  eonditions  when  the  share  of  ACA  functions  performed  by 
computers  could  be  expanded  resulting  in  numerically  justified  deeisions  and  reduced  pressure 
on  its  personnel.  This  effort  is  aimed  at  the  development  of  a  eomputer-based  system  teehnology 
that  will  enhance  ACA  operation  providing  ever-inereasing  support  to  its  personnel  without 
freeing  them  from  the  ultimate  responsibility. 

An  air  traffic  control  system  of  the  future  is  visualized  as  a  fully  decentralized,  automated 
eomputer-based  system.  Sueh  a  system  would  allow  for  the  utilization  of  the  eapabilities  of 
personnel,  equipment,  and  munitions  to  their  full  potential,  as  well  as  assuring  the  maximum 
safety  of  the  air  operation.  A  battlefield  environment  is  highly  dynamie.  The  deeentralization 
results  in  the  most  flexible  air  operation  eontrol  system  that  ean  easily  aeeommodate  for  the 
rapidly  ehanging  situations  providing  that  the  neeessary  information  is  obtained  and  proeessed  in 
a  timely  fashion.  The  latter  eould  be  achieved  only  by  eomputer-based,  fully  automatic  data 
acquisition  and  decision  support.  These  eonsiderations  are  implemented  in  the  system  for  air 
traffie  eontrol  in  the  battlefield  zone  presented  herein  with  the  goal  of  the  maximum  utilization 
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of  rapidly  changing  data  and  providing  timely  decision  support  to  personnel  of  ACA  (Wickens  et 
ah,  1998). 

The  solution  to  an  air  traffic  control/planning  problem  is  sought  in  the  spatial,  functional,  and 
time  domains.  The  spatial  aspect  of  the  problem  deals  with  geographical  maps,  coordinates  of 
the  air  bases,  targets,  airborne  refueling  stations  and  hazardous  areas,  and  the  utilization  of 
airspace.  It  results  in  the  definition  of  rational  and  safe  routes  for  particular  aircraft  connecting 
the  base  of  original  deployment  to  the  target  or  multiple  targets,  and  to  the  designated  landing 
base,  when  necessary  through  refueling  areas.  The  functional  aspect  of  the  problem  addresses 
the  task  assignment  to  particular  pilots/aircraft,  weapons-to-targets  assignment,  and  the  logistics 
of  the  entire  air  operation.  The  time-domain  aspect  of  the  problem  includes  the  scheduling  of  the 
operation  of  particular  aircraft  at  the  take-off  and  landing  stages,  in-air  refueling,  and  engaging 
targets.  It  could  be  seen  that  every  aspect  of  the  planning  process  is  dictated  by  the  tactical  and 
intelligence  information,  affected  by  weather,  and  is  consistent  with  the  technical  characteristics 
of  aircraft,  weapons,  and  targets.  The  system  is  expected  to  compile  better-than-average  air 
traffic  control  plans  that  will  be  presented  for  approval  to  ACA  personnel  in  the  enhanced,  user- 
friendly  format,  which  would  complete  the  planning  stage  of  the  process. 

The  computer-based  system  represents  the  “big  picture”  of  the  airspace  control  problem  in  the 
spatial-domain,  functional-domain  and  time-domain  based  on  a  mathematical  model.  Particular 
entities  of  the  model  “live”  in  the  simulation  environment  and  as  such,  obey  laws  of  mechanics 
and  aerodynamics,  engage  in  communication  among  themselves  and  with  the  mission  control, 
expend  fuel  and  ammunition,  experience  various  hazards,  sustain  battlefield  damage,  etc.,  and 
ultimately  provide  invaluable  feedback  for  the  enforcement  of  particular  considerations  and  rules 
of  engagement,  detection  of  conflicts  and  deconfiiction,  and  assessment  of  the  “goodness”  of  the 
planning  decisions.  The  system  obtains  numerical  solutions  of  the  particular  subsets  of  the 
airspace  control  problem  and  coordinates  “local,”  independently  obtained  solutions,  thus 
resulting  in  conflict-free,  long  and  short-term  plans  and  schedules.  The  intermediate  solutions  are 
coordinated  and  deconfiicted  with  the  enforcement  of  specific  considerations.  The  entire  solution 
task  is  visualized  as  an  ongoing,  iterative  process  driven  by  continuously  updated  databases 
reflecting  the  battlefield  dynamics  and  newly  arrived  data.  The  capability  of  incorporation  of 
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human  expertise  presented  in  a  formalized  and  intuitive  fashion,  and  aeeommodation  of  new 
rules,  eonsiderations,  and  conditions  is  viewed  as  an  important  feature  of  the  system. 

Operation  of  the  system  includes  planning  and  execution  stages.  At  the  planning  stage,  the  plan 
of  the  entire  air  operation  utilizing  time-invariant  data,  such  as  geographical  and  performance 
characteristics  of  the  aircraft,  and  a  priory  given  information,  such  as  the  initial  description  of  the 
air  operation,  is  established.  The  execution  stage  addresses  the  effect  of  all  factors  preventing  the 
implementation  of  the  accepted  plan  of  air  operation,  as  well  as  the  possible  deviations  from  the 
plan.  In  order  to  assure  the  completion  and  overall  success  of  the  operation,  the  proposed  system 
has  the  capability  of  rapid  re -planning  (deconfliction)  achieved  at  the  lowest  possible  cost.  This 
process  must  employ  some  collaboration/negotiation  between  the  involved  entities.  It  facilitates 
the  control  of  the  air  operation  and  is  accomplished  by  providing  updated  assignments  to 
individual  pilots  in  a  timely  fashion.  Consequently,  the  proposed  system  should  perform  the  data 
acquisition  task  on  a  continuous  basis  and  utilize  reliable  and  secure  communication  channels 
with  individual  aircraft,  as  well  as  successful  visualization  techniques. 

In  many  ways,  the  realization  of  the  above  capabilities  is  well  served  by  the  implementation  of 
multi-agent  system  technology  that  has  been  successfully  deployed  for  a  number  of  large-scale 
software  engineering  projects  for  industrial  and  military  applications  (Wooldridge  and  Jennings, 
1995)  and  specifically  for  airspace  control  (Tomlin  et  ah,  1997),  (Hill  et  ah,  2005).  Recent 
advancements  in  multi-agent  system  technology  provide  the  means  for  the  development  of  fully 
automated  planning,  scheduling,  and  operation  control  systems  for  complex,  multivariable 
processes  exhibiting  hybrid  (both  continuous  and  discrete)  behavior.  Modern  multi-agent 
systems  emulate  complex  collaboration  and  information  exchange  processes  taking  place  within 
a  group  of  human  experts  engaged  in  finding  a  compromise  solution  of  complex  problems. 
Driven  by  mathematically  justified  procedures  and  utilizing  high-speed  computers,  these  systems 
consistently  generate  better-than-average  and  very  prompt  solutions  that  could  be  continuously 
updated  on  the  basis  of  most  recent  information  available.  Unsurprisingly,  multi-agent  system 
technology  has  been  chosen  for  the  development  of  the  ACA  system 

This  project,  jointly  conducted  by  the  Advanced  Technical  Concepts  and  the  Gerstner 
Laboratory  of  the  Czech  Technical  University  of  Prague,  has  resulted  in  a  fully  operational 
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prototype  of  a  multi-agent  system  AGENTFLY  providing  decision  support  to  ASA.  Its 
development  became  possible  due  to  the  successful  solution  of  the  following  problems: 

1.  Mathematical  modeling  of  the  “big  picture”  in  the  functional-domain,  spatial-domain  and 
time-domain,  utilizing  various  practical  aspects  of  the  air  operation  planning  process  such  as 
types  of  manned  and  unmanned  air  vehicles  and  their  unclassified  characteristics,  types  of 
hazards,  types  of  targets,  existing  practices  and  safety  considerations,  etc. 

2.  Numerical  solution  of  the  particular  subsets  of  the  airspace  control  problem  and  coordination 
of  “local”,  independently  obtained  solutions  thus  resulting  in  a  conflict-free  long-term  and  short¬ 
term  plans  and  schedules. 

3.  Continuous  data  acquisition  addressing  the  dynamics  of  the  battlefield,  status  of  the  aircraft 
and  weather  thus  facilitating  the  ongoing,  iterative  solution  process  driven  by  continuously 
updated  databases. 

4.  Implementation  of  the  physical  realities  of  the  problem  in  the  individual  software  agents 
capable  of  negotiation  leading  to  a  numerical  solution  of  the  planning,  deconfiiction  and 
execution  tasks.  Gerstner  Laboratory  of  the  Czech  Technical  University  of  Prague  made  various 
advancements  in  the  multi-agent  system  technology  adopting  its  major  features  for  the  solution 
of  the  above  tasks  resulting  in  the  AGENTFLY  tool. 

5.  Incorporation  of  the  extensive  experience  in  the  practice  of  air  space  control  in  the  battlefield 
zone,  unclassified  specifics  of  aircraft,  implementation  of  planning  and  safety  considerations  by 
both  pilots  and  air  traffic  controllers,  interface  with  the  existing  software  and  databases,  etc., 
provided  by  Advanced  Technical  Concepts,  in  the  AGENTFLY.  This  led  to  the  development  of  a 
system  that  is  flexible,  capable  of  on-going  incorporation  of  human  expertise  presented  in 
formalized  and  intuitive  fashion,  upgradeable  by  inclusion  of  new  rules,  considerations  and 
conditions. 

6.  The  resultant  system  offers  advanced  visualization,  utilizes  advanced  graphics  and  graphic 
interfaces  making  it  user-friendly.  It  has  the  potential  for  becoming  an  integral  part  of  the  ACA 
operation. 
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7.  The  developed  teehnology  is  validated  by  a  eomprehensive  illustrative  ease  study,  featuring  a 
sophistieated  seenario  of  an  air  operation.  The  ease  study,  reeorded  on  a  CD,  has  been 
disseminated  among  relevant  government  organizations  (AF,  OSD,  FAA)  for  possible  adoption, 
further  development  and  ineorporation  in  the  existing  eomputer  systems,  and  as  a  demonstrator 
of  multi-agent  system  teehnology. 

8.  Sueeessful  eompletion  and  demonstration  of  the  results  of  this  projeet  prompted  its  most 
reeent  development:  a  study  of  the  relevanee  and  applieability  of  the  developed  teehnology  to  the 
short-term  and  long-term  plans  of  the  FAA  that  inelude  further  development  of  eomputer  support 
systems  for  air  traffie  eontrollers. 
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3.  SPECIFICS  OF  THE  AIRSPACE  CONTROL  PROBLEM 


Solution  of  the  airspace  control  problem  results  in  an  Airspace  Control  Plan  (ACP)  that  allocates 
critical  battlefield  resources,  equipment,  space,  and  time  reflecting 

-  Rules  of  engagement  and  disposition  of  air  defense  weapon  systems, 

-  Air,  land  and  maritime  situations  in  the  area  of  responsibility  such  as  existing  equipment 
limitations,  electronic  warfare,  and  C4  requirements  that  may  adversely  affect  adherence  to  the 
ACP, 

-  Anticipated  restricted  area  based  on  initial  deployment  of  friendly  forces  and  bases, 

-  Existing  air  traffic  control  areas,  base  defense  zones,  controlled  or  uncontrolled  airspace, 
and  overflight  of  neutral  nations, 

-  Mission  profiles,  combat  radii,  and  identification  capability  of  aircraft  operating  in  the 
area  of  responsibility, 

-  Enemy  air  defense  weapons  capabilities,  deployment,  and  electronic  attack/deception 
capabilities, 

-  Emergency  procedures  for  aircraft  experiencing  difficulties, 

-  Procedures  for  day,  night,  and  adverse  weather  conditions, 

-  Procedures  for  en  route  and  terminal  area  air  traffic  control  procedures  for  aircraft 
transitioning  to  and  from  the  battle  area  that  complement  planned  combat  requirements, 

-  Procedures  to  support  surge  operations  requiring  high  volumes  of  air  traffic, 

-  Enemy  offensive  air  capabilities,  vulnerability  of  defensive  counter  aircraft  to  enemy 
surface-to-air  missiles  and  vulnerability  of  friendly  surface-based  air  defenses  to  enemy  long- 
range  artillery  (Airspace...,  2005). 

It  is  important  that  a  straight-forward  attempt  to  plan/schedule  the  missions  unavoidably  requires 
that  the  following  issues  be  addressed: 

1.  Traffic  hazards  i.e.  potential  conflicts  with  other  objects  on  the  surface  or  in  flight  such 
as  other  aircraft,  missile  launches,  or  other  potential  hazards  characterized  by  the  number,  type, 
position,  and  intent  available  via  surveillance. 

2.  Current  en  route  weather  hazards  including  hail,  icing,  turbulence,  high  winds 
associated  with  thunderstorm  activity,  thunderstorm  activity  over  oceanic  airspace,  wind  shear 
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and  microburst  alerts,  intensive  preeipitation,  and  areas  of  low  visibility  and  tornadoes.  This 
information  is  available  from  the  Global  Weather  Information  System. 

3.  Rational  airspace  utilization  due  to  the  faet  that  the  value  of  the  airspaee  for  all  users 
beeomes  inereasingly  eritieal  as  military  operations,  eommereial  operations,  general  aviation, 
roeket  launehes,  and  artillery  shells  eompete  for  airspaee.  Airspaee  use/availability  information 
is  dynamie;  it  allows  utilizing  available  airspaee  to  enhanee  flight  operations  for  both  mission 
and  eeonomie  priorities. 

4.  Aircraft-to-airspace  separation  ensures  that  aireraft  maintain  a  safe  distanee  from 
speeial  use  airspaee,  sueh  as  hazardous  and  warning  areas  defined  via  intelligenee  and 
surveillanee  data  and  regulatory  publieations  and  speeifie  eontrol  instruetions.  Separation 
standards  ensure  that  aireraft  remain  at  an  appropriate  minimum  distanee  from  sueh  areas. 

5.  Aircraft-to-aircraft  en  route  separation  in  airspaee  ensures  that  a  safe  distanee  is 
maintained  between  aireraft.  Separation  standards  are  defined  for  the  different  aireraft  operating 
environments.  They  separate  aireraft  using  standard  rules  for  vertieal,  lateral,  and  longitudinal 
separation.  When  potential  eonfiiets  exist,  an  air  traffie  planner  evaluates  the  situation  and 
develops  eonfliet  resolution  alternatives.  Speeial  rules  exist  for  aireraft  to  aireraft  separation 
serviees  in  oeeanie  airspaee. 

6.  Aircraft-to-aircraft  separation  in  terminal  airspace  ensures  that  a  safe  distanee  is 
maintained  between  aireraft.  Within  terminal  airspaee,  requirements  for  separation  vary  by 
airspaee  Class.  There  are  standard  rules  for  vertieal,  lateral,  and  longitudinal  separation  methods. 
When  potential  eonfiiets  exist,  an  air  traffie  planner  evaluates  the  situation  and  develops  oonfiiet 
resolution  alternatives. 

7.  Aircraft-to-terr ain/obstacle  separation  that  ensures  that  aireraft  maintains  a  safe  distanee 
from  terrain  and  obstaeles. 

8.  Current  Surface  Separation  that  prevents  taxi  eonfiiets  and  runway  ineursions. 

Consequently,  the  planning  proeess  eonstitutes  a  number  of  parallel,  semi-autonomous 

tasks,  utilizing  eommon,  eontinuously  updated  databases  that  are  aimed  at  the  deteetion  and 
resolution  of  the  eonfiiets.  The  solution  proeess  is  typieally  deeentralized  and  results  in  “loeal” 
solutions  refieeting  “loeal”  eriteria  and  eonstraints  that  must  be  eoordinated  in  the  interests  of  the 
overall  solution  (FAA  2005). 
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4,  EXISTING  PRACTICES  OF  AIR  TRAFFIC  CONTROL 


The  air  traffic  control  system  is  a  vast  network  of  people  and  equipment  that  ensures  the  safe 
operation  of  commercial  and  private  aircraft.  Air  traffic  controllers  coordinate  the  movement  of 
air  traffic  to  make  certain  that  planes  stay  a  safe  distance  apart.  Their  immediate  concern  is 
safety,  but  controllers  must  also  direct  planes  efficiently  to  minimize  delays.  Some  regulate 
airport  traffic  through  designated  airspaces;  others  regulate  arrivals  and  departures. 

Although  airport  tower  controllers  or  terminal  controllers  watch  over  all  planes  traveling 
through  the  airport’s  airspace,  their  main  responsibility  is  to  organize  the  flow  of  aircraft  into  and 
out  of  the  airport.  Relying  on  radar  and  visual  observation,  they  closely  monitor  each  plane  to 
ensure  a  safe  distance  between  all  aircraft  and  to  guide  pilots  between  the  hangar  or  ramp  and  the 
end  of  the  airport’s  airspace.  In  addition,  controllers  keep  pilots  informed  about  changes  in 
weather  conditions  such  as  wind  shear,  a  sudden  change  in  the  velocity  or  direction  of  the  wind 
that  can  cause  the  pilot  to  lose  control  of  the  aircraft. 

During  arrival  or  departure,  several  controllers  direct  each  plane.  As  a  plane  approaches  a  base, 
the  pilot  radios  ahead  to  inform  the  terminal  of  the  plane’s  presence.  The  controller  in  the  radar 
room,  just  beneath  the  control  tower,  has  a  copy  of  the  plane’s  flight  plan  and  already  has 
observed  the  plane  on  radar.  If  the  path  is  clear,  the  controller  directs  the  pilot  to  a  runway; 
otherwise,  the  plane  is  fitted  into  a  traffic  pattern  with  other  aircraft  waiting  to  land.  As  the  plane 
nears  the  runway,  the  pilot  is  asked  to  contact  the  tower.  There,  another  controller,  who  also  is 
watching  the  plane  on  radar,  monitors  the  aircraft  the  last  mile  or  so  to  the  runway,  delaying  any 
departures  that  would  interfere  with  the  plane’s  landing.  Once  the  plane  has  landed,  a  ground 
controller  in  the  tower  directs  it  along  the  taxiways  to  its  assigned  gate.  The  ground  controller 
usually  works  entirely  by  sight  and/or  relies  on  radar  information  if  visibility  is  very  poor. 

The  procedure  is  reversed  for  departures.  The  ground  controller  directs  the  plane  to  the  proper 
runway.  The  local  controller  then  informs  the  pilot  about  conditions  at  the  airport,  such  as 
weather,  speed  and  direction  of  wind,  and  visibility.  The  local  controller  also  issues  runway 
clearance  for  the  pilot  to  take  off.  Once  in  the  air,  the  plane  is  guided  out  of  the  airbase’s  airspace 
by  the  departure  controller. 
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After  each  plane  departs,  airbase  tower  controllers  notify  enroute  controllers  who  will  now  take 
charge.  Nationally,  there  are  20  air  route  traffic  control  centers  located  around  the  country,  each 
employing  300  to  700  controllers,  with  more  than  150  on  duty  during  peak  hours  at  the  busiest 
facilities.  Airplanes  usually  fly  along  designated  routes;  each  center  is  assigned  a  certain  airspace 
containing  many  different  routes.  Enroute  controllers  work  in  teams  of  up  to  three  members, 
depending  on  how  heavy  traffic  is;  each  team  is  responsible  for  a  section  of  the  center’s  airspace. 
A  team,  as  exemplified  by  commercial  aviation,  might  be  responsible  for  all  planes  that  are 
between  30  and  100  miles  north  of  an  airport  and  flying  at  an  altitude  between  6,000  and  18,000 
feet. 

To  prepare  for  planes  about  to  enter  the  team’s  airspace,  the  radar  associate  controller  organizes 
flight  plans  coming  off  a  printer.  If  two  planes  are  scheduled  to  enter  the  team’s  airspace  at 
nearly  the  same  time,  location,  and  altitude,  this  controller  may  arrange  with  the  preceding 
control  unit  for  one  plane  to  change  its  flight  path.  The  previous  unit  may  have  been  another 
team  at  the  same  or  an  adjacent  center,  or  a  departure  controller  at  a  neighboring  terminal.  As  a 
plane  approaches  a  team’s  airspace,  the  radar  controller  accepts  responsibility  for  the  plane  from 
the  previous  controlling  unit.  The  controller  also  delegates  responsibility  for  the  plane  to  the  next 
controlling  unit  when  the  plane  leaves  the  team’s  airspace. 

The  radar  controller,  who  is  the  senior  team  member,  observes  the  planes  in  the  team’s  airspace 
on  radar  and  communicates  with  the  pilots  when  necessary.  Radar  controllers  warn  pilots  about 
nearby  planes,  bad  weather  conditions,  and  other  potential  hazards.  Two  planes  on  a  collision 
course  will  be  directed  around  each  other.  If  a  pilot  wants  to  change  altitude  in  search  of  better 
flying  conditions,  the  controller  will  check  to  determine  that  no  other  planes  will  be  along  the 
proposed  path.  As  the  flight  progresses,  the  team  responsible  for  the  aircraft  notifies  the  next 
team  in  charge  of  the  airspace  ahead.  Through  team  coordination,  the  plane  arrives  safely  at  its 
destination. 

Both  tower  and  enroute  controllers  usually  control  several  planes  at  a  time;  often,  they  have  to 
make  quick  decisions  about  completely  different  activities.  For  example,  a  controller  might 
direct  a  plane  on  its  landing  approach  and  at  the  same  time  provide  pilots  entering  the  airport’s 
airspace  with  information  about  conditions  at  the  airport.  While  instructing  these  pilots,  the 
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controller  also  might  observe  other  planes  in  the  vieinity,  sueh  as  those  in  a  holding  pattern 
waiting  for  permission  to  land,  to  ensure  that  they  remain  well  separated. 

In  addition  to  airbase  towers  and  enroute  eenters,  air  traffie  eontrollers  also  work  in  flight  serviee 
stations  operated  at  more  than  100  loeations  nationally.  These  flight  service  specialists  provide 
pilots  with  information  on  the  station’s  partieular  area,  ineluding  terrain,  pre flight  and  inflight 
weather  information,  suggested  routes,  and  other  information  important  to  the  safety  of  a  flight. 
Flight  serviee  speeialists  help  pilots  in  emergeney  situations  and  initiate  and  eoordinate  searehes 
for  missing  or  overdue  aireraft.  However,  they  are  not  involved  in  aetively  managing  air  traffie. 
Some  national  air  traffie  eontrollers  work  at  the  FAA’s  Air  Traffie  Control  Systems  Command 
Center  in  Herndon,  VA,  where  they  oversee  the  entire  system.  They  look  for  situations  that  will 
ereate  bottleneeks  or  other  problems  in  the  system,  and  then  respond  with  a  management  plan  for 
traffie  into  and  out  of  the  troubled  seetor.  The  objeetive  is  to  keep  traffie  levels  in  the  trouble 
spots  manageable  for  the  eontrollers  working  at  enroute  eenters. 

The  FAA  has  implemented  an  automated  air  traffie  eontrol  system,  ealled  the  National  Airspaee 
System  (NAS)  Arehiteeture.  The  NAS  Arehiteeture  is  a  long-term  strategie  plan  that  will  allow 
eontrollers  to  more  effieiently  deal  with  the  demands  of  inereased  air  traffie.  It  eneompasses  the 
replaeement  of  aging  equipment  and  the  introduetion  of  new  systems,  teehnologies,  and 
proeedures  to  enhanee  safety  and  seeurity  and  support  future  aviation  growth.  The  NAS 
Arehiteeture  faeilitates  eontinuing  diseussion  of  modernization  between  the  FAA  and  the 
aviation  eommunity  (Nolan,  1990). 

While  the  above  deseription  primarily  refleets  the  operation  of  eommereial  aviation,  it  provides 
suffieient  detail  for  the  purpose  of  this  projeet. 
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5.  MULTI-AGENT  PLANNING  AND  EXECUTION  PROCESSES 


In  the  nearest  future,  the  advaneed  methods  of  eomputer  scienee  and  artifieial  intelligenee  will 
play  a  pivotal  role  in  air  traffie  eontrol  of  military  and  eivilian  as  well  as  manned  and  unmanned 
aerial  vehicles.  We  have  been  investigating  the  use  of  agent  based  technology  and  the  multi¬ 
agent  algorithms  for  deployment  in  this  specific  application  domain. 

Multi-agent  system  is  a  collection  of  loosely  coupled  autonomous  programs  that  perform 
collective  behavior  and  collective  decision  making  by  means  of  interaction,  negotiation, 
cooperation  but  also  methods  of  teamwork,  competition  or  social  dominance.  Multi-agent  system 
domain  provides  a  wide  selection  of  ready  to  use  COTS  or  open  source  integration  platforms  as 
well  as  various  techniques  and  algorithms  suitable  for  different  coordination  tasks. 

The  use  of  this  highly  innovative  technology  is  appropriate  in  the  situations  where  the  data 
required  for  decision  making  are  not  available  centrally.  As  air  traffic  control  domain  needs  to 
move  to  less  human  driven  problem  and  a  problem  more  suited  for  automated  decision  making, 
we  expect  that  substantial  amount  of  computation  and  data  maintenance  will  be  onboard  of  the 
aircraft.  Similarly,  the  future  air-traffic  operation  (especially  in  battle-field  or  surveillance 
operations)  will  require  techniques  implementing  safe,  fast  and  robust  deconfliction  algorithms 
and  would  allow  for  other  replanning  scenarios  in  highly  dynamic  and  unpredictable 
environment. 

This  expectation  leads  to  investigation  of  a  highly  decentralized  decision  making  systems  that 
will  make  an  important  use  of  the  available  multi-agent  technologies.  Operation  of  a  multi-agent 
air  traffic  control  system  is  supposed  encapsulate  the  following  3  decision  making  phases: 

5.1.  Data  acquisition 

Time-invariant  data  includes  geographical  information  (digital  map);  performance  characteristics 
of  aircraft,  primarily  operational  speed  ranges  and  fuel  bum  rates  given  for  various  Standard 
Configuration  Loads  (STL);  coordinates  of  the  friendly  airbases;  and  airspace  design  (aircraft 
separation)  criteria  that  could  be  defined  for  various  visibility  conditions  (i.e.,  sizes  of  the  air 
corridors  and  tunnels,  and  communication,  alert,  safety,  and  collision  zones  around  aircraft). 
Airspace  design  criteria  are  established  based  on  the  capability  of  aircraft  to  accurately  fly  and 
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maintain  pressure  altitudes  in  higher  altitude  eruise  and  based  on  the  eapability  of  the  aireraft  and 
the  relationship  to  separation  eriteria  in  lower  altitude  situations.  Airspaee  design  eriteria  for 
flight  objeets  for  a  speeial  use  (hazardous/restrieted)  airspaee  aetivity  inelude  the  time  duration 
and  volume  of  airspaee  around  the  trajeetory  required  to  exeeute  the  mission.  This  addresses 
dynamie  airspaee  restrietions  with  variable  separation  for  seeurity,  military  operations,  remotely 
operated  aireraft,  and  reusable  launeh  vehieles.  Time-varying  data  ineludes  the  plan  of  the  air 
operation  that  designates  targets  for  partieular  aireraft  (pilots)  and  assigns  weapons  to  target  and 
defines  the  NET  (not  earlier  than)  and  NET  (not  later  than)  times  for  partieular  target;  weather- 
related  information;  eoordinates  and  status  of  partieular  targets;  and  hazardous  areas,  also  known 
as  speeial  use  airspaee  (areas  defended  by  SAMs,  areas  oeeupied  by  flying  artillery  shells,  roeket 
launehes,  ete.).  It  eould  be  seen  that  this  information  refleets  the  battlefield  dynamies,  i.e., 
ehanging  goals  of  the  air  operation,  neutralization  of  targets  and  deteetion  of  new  targets  and 
hazardous  areas,  ehanging  weather  eonditions,  ete.  Einally,  reported  data  represents  the  eurrent 
status  of  the  partieular  aireraft,  sueh  as  payload,  teehnieal  status,  available  fuel  status,  and  aetual 
aireraft  position. 

5.2.  Initial  planning 

The  first  step  of  the  initial  planning  proeess  begins  with  establishing  a  logieal  time  schedule  for 
the  neutralization  of  particular  targets  that  constitute  a  subset  of  the  air  operation  plan.  This  is 
followed  by  assigning  aircraft/weapons  to  targets,  selection  of  take-off  airbases,  and  the  bases 
where  aircraft  are  to  return  after  the  completion  of  the  mission.  Temporal  coordinates  of  the  rest 
of  the  node  points  are  to  be  calculated  based  on  the  average  speed  of  the  aircraft  and  the 
geometrical  distance  between  the  appropriate  locations.  At  the  next  step  of  the  initial  planning, 
all  intermediate  points  of  the  aircraft  paths  are  to  be  calculated  by  interpolation,  assuming  that 
the  node  points  are  connected  by  straight  lines  in  the  four-dimensional  space.  The  number  of 
intermediate  points  is  defined  according  to  some  chosen  time  step  and  average  speed  of  the 
aircraft. 

5.3.  Deconfliction 

The  flight  plans  that  are  results  form  the  initial  planning  process  may  contain  possible  conflicts 
and  collision  situations.  Collision  avoidance  is  not  solved  during  the  initial  planning  process  due 
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to  high  computational  requirements  related  to  this  proeess  and  due  to  high  dynamies  of  expected 
flight  traffic.  The  detection  and  resolution  of  the  eonfliets  eriteria  utilized  in  this  proeess  are 
defined  based  on  the  eapability  of  aireraft  to  aecurately  fly  and  maintain  required  altitudes. 
Criteria  for  flight  objeets  for  a  speeial  use  (hazardous/restricted)  airspaee  aetivity  include  the 
time  duration  and  volume  of  airspaee  around  the  trajeetory  required  to  exeeute  the  mission.  This 
addresses  dynamie  airspaee  restrictions  with  variable  separation  for  seeurity,  military  operations, 
remotely  operated  aireraft,  and  reusable  launeh  vehieles.  It  should  be  emphasized  that  deteetion 
and  resolution  of  the  eonfliets  takes  into  eonsideration  weather  eonditions,  time  of  the  air 
operation,  and  the  geographieal  region  that  dictates  the  size  of  the  air  eorridors,  air  tunnels, 
eommunieation,  and  alarm  and  danger  zones  surrounding  aircraft. 

The  deeonflietion  proeess  ean  be  physieally  embedded  in  the  initial  planning  phase  or  fight 
exeeution  phase,  deseribed  below.  If  deeonfliotion  is  to  be  executed  during  initial  planning  it 
needs  to  be  implemented  on  top  of  a  multi-agent  simulation  of  the  flight-plans  elaborated  during 
the  initial  planning  proeess.  Possible  collisions  will  be  resolved  by  the  multi-agent  deeonfleition 
methods  and  log  of  the  resulting  operation  will  provide  the  final  non-eonflieting  plans.  More 
natural  alternative  is  to  implemented  deeonflietion  within  the  flight  execution  process.  The 
aircraft  would  follow  their  mission  plan  and  carry  out  deeonflietion  process  up  in  the  air.  This 
coneept  is  referred  to  as  free-flight  and  is  particularly  suitably  for  unmanned  aerial  vehiele 
operation. 

5,4.  Flight  execution 

The  exeeution  stage  addresses  the  effect  of  all  factors  preventing  the  implementation  of  the 
aeeepted  plan  of  air  operation.  These  faetors  inelude  unexpeeted  ehanges  in  weather  eonditions, 
damage  sustained  by  partieular  aireraft,  aetual  fuel  status,  newly  deteeted  targets  and  hazardous 
zones,  failure  to  neutralize  targets  aeeording  to  the  plan,  failure  to  follow  the  required  sehedule, 
failure  to  stay  within  the  designated  eorridor/tunnel,  ete.  It  eould  be  seen  that  in  addition  to 
making  the  goals  of  air  operation  unattainable,  these  faetors  ean  result  in  additional  eonfiiots.  In 
order  to  minimize  the  effeet  of  these  factors  on  the  eompletion  and  overall  sueeess  of  the 
operation,  the  proposed  system  has  the  eapability  of  rapid  re-planning  (deeonflietion)  achieved  at 
the  lowest  possible  eost.  This  proeess  must  employ  some  eollaboration/negotiation  between  the 
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involved  entities.  It  faeilitates  the  eontrol  of  the  air  operation  and  is  aoeomplished  by  providing 
updated  assignments  to  individual  pilots  in  a  timely  fashion.  Unlike  the  initial  planning,  eonfliet 
resolution  at  this  stage  implies  a  deeision  proeess  that  takes  into  aeeount  when  reported  (real) 
data  on  teehnieal  status  of  the  involved  aireraft  is  available,  amount  of  fuel  on  board,  and  the 
aireraft  position. 
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6.  IMPLEMENTATION  ASPECTS 


The  agent-based  air  traffie  based  on  the  arehiteeture  listed  in  the  previous  seetion  has  been 
designed  reeently  and  has  been  implemented  on  top  of  the  y?-globe  multi-agent  platform  (Sislak 
et  ah,  2005)  and  has  been  presented  at  (Peehoueek  et.  al,  2006).  The  system  features  teehnology 
for  agent  based  flight  modeling,  air-traffie  planning  meehanism  for  a  single  plane,  rule-based  and 
utility  based  deeonflietion  meehanisms  (See  Fig.  1.).  Speeifie  negotiation-based  eonfliet 
resolution  proeedures  have  been  developed  and  implemented  in  multi-agent  environment 
originally  suggested  by  (Sehulz  et  al.  1997),  (Tomlin  et  al.  1997),  and  further  developed  for 
airspaee  deeonfliotion  by  (Peehoueek  et  al.  2006).  The  deeonflietion  meehanism  is  distributed  by 
its  nature  that  allows  for  addressing  the  high  volume  of  eomputations  assoeiated  with  the 
solution  of  this  problem. 

Currently,  massive  sealability  tests  are  under  development.  The  developed  system  also  provides 
3-dimensional  and  web-aeeessible  2-dimensional  presentation  (GUI)  layer  (see  Fig.  2).  The 
system  performs  data-fusion  on  top  of  various  data  from  freely  available  data-sourees  that  have 
been  integrated  in  the  system  (e.g.  mosaie  of  Landsat7  images,  USGS  geographieal  data,  GNIS 
name -related  data,  but  also  almost  real-time  data  from  the  airport  traffie  monitors  of  major  U.S. 
airports). 
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Airplane  A 


Airplane  B 


Figure  1.  Deconfliction  Negotiation  Protocol 


J  ava  Apci&accn 


Figure  2.  Presentation  Layer 
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7.  QUANTIFYING  THE  PROBLEM  IN  A  MULTI-AGENT  ENVIRONMENT 


Air  traffic  planning  results  in  a  flight  plan  for  each  participating  aircraft  that  assures  that  the 
goals  of  the  air  operation  are  fulfilled  in  the  most  safe  and  efficient  fashion.  The  flight  plan  is 
represented  by  a  sequence  of  waypoints  established  in  the  specially  defined  state  space.  Safety 
issues  are  to  be  addressed  through  the  existing  planning  considerations  incorporated  in  the 
computational  procedure  responsible  for  the  definition  of  the  waypoints. 

A  waypoint  is  assumed  to  be  a  point  in  the  four-dimensional  aircraft  state  space 


W=[x,  y,  z,  t] 


(1) 


where  x,  y,  z  ,  t  -  represent  spatial  coordinates  of  an  aircraft  and  time. 

Some  of  the  waypoints,  crucial  to  the  mission  of  the  flight,  are  to  be  designated  as  the  target 
points. 

The  state  of  an  aircraft  at  any  moment  of  time,  f  ,  i=l,2,3,  ...  is  defined  by  vector 

V(ti)=[x(tO,  y(tO,  z(tO,  f(tO,  p(ti),  s(ti)]  (2) 


where 

f-  amount  of  fuel  on  board, 
p  -  payload, 
s  -  technical  status,  and 
j  -  is  the  aircraft  type  index. 

For  the  purpose  of  this  project  amount  of  fuel  on  board,  payload,  and  technical  status  of  an 
aircraft  will  be  expressed  in  percent  of  maximum  attainable. 

State  vector  V(ti)  is  defined  by  a  computation  and/or  by  a  status  report.  When  the  initial 
condition  V(ti.i)  and  the  waypoint  of  interest  [x(ti),  y(ti),  z(ti)]  are  known,  the  amount  of  fuel  f  (f) 
is  calculated  by  the  designated  software  agent  as  follows. 


f(tO=  f(h.i)-  6f  T 


(3) 
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where 


5f  =(Pj[p(ti)],  j=l,  2,  3,  ...  are  different  for  different  aircraft  and  depend  on  its  specific 
configuration  (Standard  Configuration  Load  -  SCL)  and  payload.  These  functions  are 
defined  by  a  special  database.  Note  that  the  altitude  and  the  increment  of  the  spatial 
coordinates  between  f-i  and  ti  moments  have  little  effect  on  the  fuel  burn  rate  for  particular 
aircraft. 

While  technical  characteristics  of  the  aircraft,  (pj[...],  j=l,  2,  3,  ...  known  as  burn  rate  functions 
may  be  classified,  for  the  purpose  of  this  project,  the  choice  of  these  functions  reflects  only  the 
expectations  of  the  members  of  the  project  team  who  do  not  have  any  access  to  classified 
information. 

It  should  be  noted  that  quantities  f(ti)  and  p(ti)  could  be  known  directly  from  the  automatic 
reporting  system  and/or  pilot’s  report,  in  this  case  the  reported  value  will  replace  the  calculated 
value.  The  payload  p(ti)  is  expected  to  change  upon  reaching  some  target  points  or  reported  by 
the  pilot,  again,  the  reported  value  will  replace  the  calculated  value.  The  aircraft  status,  s(ti), 
reflecting  the  possible  battlefield  damage  is  expected  to  be  reported  by  the  pilot. 

7.1.  Acquiring  relevant  information 

Relevant  information  will  be  organized  in  the  three  classes,  one  containing  time-invariant  data 
that  has  to  be  accessed  only  once  per  planning  process,  the  second,  containing  time -varying  data 
that  has  to  be  accessed  at  each  step  of  the  planning  procedure,  and  the  third  one,  that  constitutes 
the  reports  that  drive  the  planning  procedure. 

Time-invariant  data  is  obtained  from 

Database- 1  containing  geographical  information  (digital  map), 

Database-2  containing  performance  characteristics  of  aircraft  (fuel  burn  rates  for  particular 
aircraft  and  SCL), 

Database-3  containing  coordinates  of  the  friendly  airbases,  and 

Database-4  sizes  of  the  air  corridors  and  tunnels,  and  communication,  alert,  safety  and 
collision  zones  around  aircraft 
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Time-varying  data  is  provided  by 

Database-5  eontaining  the  plan  of  the  air  operation, 

Database-6  -  weather  information, 

Database-7  -  status  and  eoordinates  of  targets,  and 

Database-8  -  hazardous  and  restricted  areas  (special  use  air  space) 

Reported  data  is  organized  into 

Database-9  that  includes  payload  status  (%),  technical  status,  and  fuel  status  (%),  and 
actual  aircraft  position 

Output  data  is  defined  by  Database- 10 

7.2.  Initial  planning 

The  first  step  of  the  initial  planning  process  begins  from  establishing  a  logical  time  schedule  for 
the  neutralization  of  particular  targets.  This  is  followed  by  assigning  aircraft/weapons  to 
particular  targets,  selection  of  departure  airbases,  and  the  bases  where  aircraft  are  to  return  after 
the  completion  of  the  mission.  The  resultant  information  is  summarized  as  three  or  more  target 
points 


Pn[x(k),  y(k),  z(k),  t(k)] 


(4) 


where 

n=l,2,3,  ...  represents  particular  aircraft, 

k=l,2,3,  ....correspond  to  the  airbase  of  departure,  designated  target(s),  and  the  airbase  of 
return, 

x(k),  y(k),  z(k),  t(k)  are  spatial  and  temporal  coordinates  of  the  target  points. 

It  should  be  emphasized  that  only  t(k)  values  representing  arrival  times  to  the  target  locations, 
crucial  for  the  air  operation,  are  to  be  pre-specified.  Temporal  coordinates  of  the  rest  of  the  target 
points  are  to  be  calculated  based  on  the  average  speed  of  the  aircraft  and  the  geometrical  distance 
between  the  appropriate  locations. 
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At  the  second  step  if  the  initial  planning  all  intermediate  way  points  are  to  be  calculated  by 
interpolation  assuming  that  the  target  points  are  connected  by  straight  lines  in  the  four¬ 
dimensional  space.  The  number  of  waypoints  is  defined  according  to  some  chosen  time  step  T. 

The  third  step  of  the  initial  planning  is  aimed  at  the  detection  and  resolution  of  the  conflicts  thus 
resulting  in  addressing  the  following  issues: 

1 .  Traffic  hazards 

2.  Current  en  route  weather  hazards 

3.  Rational  airspace  utilization 

4.  Aircraft- to-airspace  separation 

5.  Aircraft-to-aircraft  en  route  separation 

6.  Aircraft-to-aircraft  separation  in  terminal  airspace 

7.  Aircraft-to-terrain  /  obstacle  separation 

8.  Current  Surface  Separation 

Airspace  design  using  space-based  criteria  (separation  criteria)  are  developed  based  on  the 
capability  of  aircraft  to  accurately  fly  and  maintain  pressure  altitudes  in  higher  altitude  cruise  and 
based  on  the  capability  of  the  aircraft  and  the  relationship  to  separation  criteria  in  lower  altitude 
situations.  Airspace  design  criteria  for  flight  objects  for  a  special  use  (hazardous/restricted) 
airspace  activity  that  include  the  time  duration  and  volume  of  airspace  around  the  trajectory 
required  to  execute  the  mission.  This  addresses  dynamic  airspace  restrictions  with  variable 
separation  for  security,  military  operations,  remotely  operated  aircraft  and  reusable  launch 
vehicles. 

It  should  be  emphasized  that  detection  and  resolution  of  the  conflicts  is  to  be  done  on  the  basis  of 
weather  condition,  time  of  the  air  operation  and  the  geographical  region  that  dictate  the  sizes  of 
the  air  corridors,  air  tunnels,  and  communication,  alarm  and  danger  zones  surrounding  aircraft 
(see  airspace  design  criteria). 

7.3.  Current  planning/execution 

It  could  be  summarized  that  the  initial  planning  has  three  special  features:  it  addresses  primarily 
geometric  considerations,  it  does  not  utilize  the  time-dependent  state  of  the  aircraft,  and  it  does 
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not  rely  on  the  “feedback  information”  representing  the  actual  state  of  the  aircraft.  Consequently, 
it  is  performed  only  once  prior  the  air  operation.  The  current  planning/execution  stage  constitutes 
an  on-going  effort  reflecting  continuously  changing  details  of  the  air  operation,  such  as 
neutralized  targets,  neutralized  and  newly  detected  hazardous  zones,  newly  detected  targets, 
deviations  of  the  aircraft  from  their  scheduled  paths,  changing  technical  status  of  the  aircraft,  etc. 
In  addition,  current  planning  is  to  be  performed  on  a  smaller  time  step,  t«T. 

7,4.  State  assessment  task 

The  ever  changing  state  of  the  particular  aircraft  i.e.  its  three  spatial  coordinates,  amount  of  fuel 
on  board,  payload  and  technical  status  are  taken  into  account  by  designated  software  agents  at 
every  step  of  the  planning  procedure, 

ti=i-T,  i=l,2,3,...  (5) 

a)  Calculated  aircraft  state  data  at  time  f 

Spatial  coordinates  are  obtained  by  the  interpolation  on  the  basis  of  the  paths  defined  by 
the  initial  planning.  Amount  of  fuel  on  board  is  calculated  on  the  basis  of  the 
characteristics  of  the  particular  aircraft  type  and  SCL  and  the  payload  pCfii).  The  payload 
p(ti)  is  assumed  to  be  equal  to  its  previous  value,  p(ti.i),  unless  waypoint  x(ti.i),  y(ti.i),  z(ti.i) 
is  a  target  point  representing  an  enemy  target.  The  technical  status  of  the  aircraft,  s(ti),  is 
assumed  to  be  equal  to  its  previous  value,  s(ti.i) 

b)  Reported  aircraft  state  data  at  time  f 

Reported  spatial  coordinates  are  obtained  by  the  means  of  radar  and/or  GPS.  The  amount 
of  fuel  on  board,  payload,  and  the  technical  status  (battlefield  damage)  of  the  aircraft  are 
reported  by  the  pilot.  Note  that  for  the  planning  purpose  any  information  reported  during 
the  time  period 


[h-i,h]  (6) 

overwrites  the  appropriate  calculated  aircraft  state  data  at  time  ti 

7,5.  Deconfliction  task 

This  task  is  aimed  at  the  detection  and  resolution  of  the  conflicts  thus  resulting  in  addressing  the 
following  issues: 
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1 .  Traffic  hazards 

2.  Current  en  route  weather  hazards 

3.  Rational  airspace  utilization 

4.  Aireraft-to-airspaee  separation 

5.  Aireraft-to-aircraft  en  route  separation 

6.  Aireraft-to-aireraft  separation  in  terminal  airspaee 

7.  Aircraft- to-terrain  /  obstacle  separation 

8.  Current  Surface  Separation 

9.  Speeial  use  (hazardous/restrieted)  airspace  aetivity 

It  should  be  emphasized  that  deteetion  and  resolution  of  the  conflicts  is  to  be  done  on  the  basis  of 
weather  condition,  time  of  the  air  operation  and  the  geographieal  region  that  dietate  the  sizes  of 
the  air  eorridors,  air  tunnels,  and  communication,  alarm  and  danger  zones  surrounding  aircraft, 
i.e.  parameters  that  constitute  the  airspace  design  criteria. 

Unlike  the  initial  planning,  conflict  resolution  implies  a  negotiation  proeess  that  takes  into 
account  (a)  technical  status  of  the  involved  aircraft,  (b)  amount  of  fuel  on  board  the  involved 
aircraft,  (c)  impact  of  the  proposed  maneuver  on  the  amount  of  fuel,  and  (d)  the  impact  of  the 
proposed  maneuver  on  the  overall  schedule  of  the  air  operation. 

7,6,  Methods  of  Deconfliction 

The  specific  negotiation-based  conflict  resolution  proeedures  have  been  developed  and 
implemented  in  multi-agent  environment  originally  suggested  by 

R.  Schulz,  D.  Shaner,  and  Y.  Zhao.  Free-flight  concept.  Proceedings  of  the  AiAA 
Guidance,  Navigation  and  Control  Conference,  pages  999-903,  New  Orelans,  LA,  1997, 

C.  Tomlin,  G.  Pappas,  and  S.  Sastry.  Conflict  resolution  for  air  traffic  management:  A  case 
study  in  multi-agent  hybrid  systems,  IEEE  Transactions  on  Automatic  Control,  August  1997, 
and  adopted  and  specially  developed  for  the  purpose  of  this  projeet  by  M.  Peehoucek  at  ah,  see 
“Autonomous  Agents  in  Air-Traffie  Control”,  Final  Report  to  FOARD  on  project 
FA8655-04-1-3044-P00001,  extension  of  the  FA8655-04-1-3044  contract,  Gerstner  Laboratory  - 
Agent  Technology  Group,  Department  of  Cybernetics,  Czech  Technical  University  Prague, 
Czeeh  Republic 
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AGENTFLY  -  FA8655-04-1-3044-P00001,  Gerstner  Faboratory  -  Agent  Technology 
Group,  Department  of  Cybernetics,  Czech  Technical  University  Prague,  Czech  Republic 

The  proposed  deconfliction  mechanism  is  distributed  by  its  nature  that  allows  for  addressing  the 
high  volume  of  computations  associated  with  the  solution  of  this  problem.  The  aircraft  are 
modeled  by  agent  containers  hosting  several  agents,  representing  particular  aircraft.  An  agent  is  a 
self-interested  entity  that  is  in  charge  of  (i)  preparing  a  detailed  flight  plan  for  the  airplane 
respecting  time-specific  waypoints  for  the  airplane’s  mission  and  (ii)  executing  the  detailed  flight 
plan  by  performing  the  simulated  flight.  For  the  purpose  of  implementing  agent-based 
deconfliction  procedure,  each  simulated  aircraft  is  surrounded  by  a  number  of  concentric 
spherical  zones:  communication,  alert,  safety  and  collision  zones.  The  communication  zone  is  the 
outermost  one.  It  represents  the  voice  communication  range  of  the  transponder  and  data 
transmitter  onboard  the  aircraft.  Using  this  data,  the  aircraft  can  send  data  packets  to  other 
aircraft  that  are  positioned  within  the  specified  spherical  zone  defined  by  its  radius.  The  alert 
zone  defines  the  operation  range  of  the  radar  onboard  the  aircraft.  If  another  aircraft  is  located 
within  the  alert  zone,  the  aircraft  are  periodically  notified  about  its  relative  position  and  its  flight 
code.  The  safety  zone  encapsulates  the  area  around  an  aircraft  that  other  aircraft  are  not  allowed 
to  enter  in  order  to  assure  the  safe  operation  of  each  aircraft.  The  size  of  this  zone  is  not  constant, 
but  is  determined  by  the  aircraft  type,  its  current  tasks  and  the  environment,  allowing  higher 
degree  of  freedom  when  the  environment  is  adversarial.  Safety  zone  radius  can  change 
dynamically  during  the  flight.  If  two  aircraft  do  enter  each  other’s  safety  range,  they  can  still 
continue  flying  but  their  flight  path  may  be  influenced  by  e.g.  turbulence.  This  is  not  the  case 
when  two  or  more  airplanes  fly  together  in  a  close  formation.  The  collision  zone  is  the  innermost 
zone.  It  defines  the  critical  contact  area.  When  the  mutual  distance  between  two  aircraft  is 
smaller  than  the  sum  of  their  collision  zone  radiuses,  the  physical  collision  happens. 

The  deconfliction  has  two  formats,  cooperative  and  non-cooperative. 

Cooperative  deconfliction  is  intended  for  the  encounter  of  two  or  more  friendly  aircraft.  It 
implies  that  the  agents  representing  the  involved  aircraft  avoid  collisions  cooperatively  by 
negotiation.  The  negotiation  starts  as  one  aircraft  enters  the  alert  zone  of  another.  It  includes  the 
on-going  exchange  of  the  state  information  and  plane  ID  and  consequent  negotiation.  It  is 
important  that  the  negotiation  procedure  takes  into  account  all  state  components,  including  the 


24 


position,  amount  of  fuel  on-board,  and  technical  status  of  the  aircraft.  The  nature  of  the 
negotiation  mechanism  is  described  in 

J.  C.  Hill,  F.  R.  Johnson,  J.  K.  Archibald,  R.  L.  Frost,  and  W.  C.  Stirling.  “A  cooperative 
multi-agent  approach  to  free  flight”,  AAMAS,  pages  1083-1090,  2005, 

Non-cooperative  deconfliction  includes  the  detection  and  avoidance  of  such  obstacles  as 
terrain,  structures,  hazardous  zones,  local  weather  phenomena,  and  in  addition,  autonomous  air 
vehicles  and  enemy  aircraft.  The  procedure  includes  the  collision  detection,  i.e.  the  algorithm 
that  analyzes  flight  paths  and  tests  the  safety  range  violation,  and  the  rule-based  flight  path 
modification,  that  may  also  include  the  analysis  of  the  potential  conflicts  caused  by  this 
modification,  see 

J.  C.  Hill,  F.  R.  Johnson,  J.  K.  Archibald,  R.  L.  Frost,  and  W.  C.  Stirling.  “A  cooperative 
multi-agent  approach  to  free  flight”,  AAMAS,  pages  1083-1090,  2005. 

7.7.  Data  representation 

Data  representation  will  feature  three  displays: 

The  “big  picture”  display  representing  the  entire  battlefield  situation,  the  conflict  display 
featuring  areas  of  potential  conflicts,  and  the  individual  pilot’s  display  featuring  its  individual 
path  and  the  areas  of  potential  conflicts.  The  displayed  information  will  include  a  fraction  of  the 
path  of  each  aircraft  within  the  waypoints  of  interest. 

Data  Structure/Format 

Dependable  operation  of  the  computer-based  air  traffic  control  system  requires  access  to  several 
existing  databases,  including  those  containing  sensitive  and  classified  information.  The  project 
teams,  including  a  Czech  Multi-Agent  System  Technology  group,  do  not  have  access  to 
classified  information  and  are  not  authorized  to  use  sensitive  information.  Moreover,  application 
of  semi-autonomous  software  agents,  especially  those  developed  in  foreign  countries  does  not 
constitute  an  advisable  database  scanning  technology.  Existing  unclassified  “training”  databases 
while  representing  the  actual  data  structure  contain  effectively  random  numbers  that  are 
unsuitable  for  any  reasonably  realistic  demonstration  of  the  developed  technology. 
Consequently,  at  the  current  stage  of  the  system  development  all  relevant  data  is  placed  in  the 
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following  databases  containing  improvised,  but  realistic  looking  data  expressed,  when 
applicable,  in  relative  units. 


The  data  is  organized  in  the  following  classes:  time-invariant  data,  time-varying  data,  reported 
data,  and  the  output  data. 

Time-invariant  data 

1.  Database  1  contains  geographical  information  (digital  map).  According  to  the  project 
specification,  the  geographical  region  is  to  be  specified  via  the  system  portal  available  on  the 
Internet  to  authorized  users.  At  the  present  stage  of  the  project,  for  the  purpose  of  presentation, 
only  one  geographical  region,  Mojave  Desert,  is  available. 


2.  Database  2  contains  fuel  bum  rate  of  aircraft 


Table  1.  Fuel  Burn  Rate  Of  The  Aircraft 


Aircraft 

Aircraft 

Standard  Configuration 

Fuel  bum  rate 

index 

Type 

Eoad 

(%  of  full  tank  per  hour) 

Full  Eoad 

Unloaded 

1 

F15E 

4M82J3 

20 

12 

1 

F15E 

8G27J2 

31 

14 

1 

F15E 

2G27J3 

18 

12 

2 

F16C 

4M84G2 

19 

14 

2 

F16C 

6M84G3 

20 

16 

2 

F16C 

2G27J3 

16 

14 

3 

B52H 

55G31 

8 

7 

3 

B52H 

31V31 

7.5 

7 

3 

B52H 

6A88 

7.8 

7 
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3.  Database  3  contains  coordinates  of  the  friendly  airbases 


Table  2.  Coordinates  Of  The  Friendly  Airbases 


Base  index-Name 

X 

Degrees,  minutes, 

seeonds 

Y 

Degrees,  minutes, 

seeonds 

1-Name 

2-Name 

3 -Name 

4-Name 

4.  Database  4  contains  sizes  of  the  air  corridors  and  tunnels,  and  communication,  alert, 
safety  and  collision  zones  around  aircraft 

Table  3.  Commnnication,  Alert,  Safety  and  Collision  Zones  Of  The  Aircraft,  Sizes  Of  The  Air  Corridors  and 
Tnnnels 


Air  spaee  element 

Size 

Corridor 

±100  ft 

Tunnel 

±500  ft 

Communieation  zone 

150  n  miles 

Alert  zone 

15  n  miles 

Safety  zone 

5NM 

Collision  zone 

1  NM 
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Time-varying  data 

1.  Database  5  contains  the  plan  of  the  air  operation  (NLT  -  not  later  than,  NET  -  not 
earlier  than) 


Table  4.  Plan  Of  The  Air  Operation 


Aircraft 

Aircraft 

Aircraft 

Departing 

Returning 

Targets 

index 

ID 

type 

base  index 

base 

Target  1 

Target  2 

index 

index 

Time 

Time 

index 

Time 

Time 

NLT 

NET 

NLT 

NET 

1 

M123 

2 

3 

3 

2 

C511 

3 

6 

2 

3 

V1341 

7 

1 

3 

E1205 

2.  Database  6  contains  weather  information;  not  used 


Table  5.  Weather  Information 


Reported 

time  frame 

Weather 

Factor 

Intensity 

on  the  scale  0  to  10 

Time 

Weather 

classifier 

Day 

Night 

Dusk 

1407 

1600 

Rain 

7 

1 

0 

0 

8 

Snow 

0 

Thunderstorm 

2 

Fog 

5 

Visibility 

3 

1524 

1900 

Rain 

0 

0 

0 

1 

12 

Snow 

0 

Thunderstorm 

1 

Fog 

6 

Visibility 

2 
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3.  Database  7  contains  status  and  coordinates  of  targets 


Table  6.  Status  And  Coordinates  Of  Targets 


Target 

Index 

X-eoordinate 

(Longitude) 

Degrees,  minutes,  seeonds, 

deeiseeonds 

Y -eoordinate 

(Lattitude) 

Degrees,  minutes,  seeonds, 

deeiseeonds 

Target  deseription 

Status 

1 

Radar  station 

antenna 

aetive 

2 

Air  base,  center  of 

runway 

aetive 

3 

4 

5 

6 

4.  Database  8  defines  hazardous  areas 


Table  7.  Hazardous  Areas 


# 

Cylinder 

Layer 

t/5 

£ 

Center 

Radius 

X 

Y 

X 

Y 

X 

Y 

X 

Y 

D 

1 

S 

's 

X 

Y 

miles 

1 

1 

2 

2 

3 

3 

4 

4 

X 

bX) 

s 

o 

b 

t/5 

D 

Q 

Status 

1 

xxxx 
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Reported  data 

1 .  Database-9  includes  payload  status  (%),  technical  status  (%),  and  fuel  status  (%) 


Table  8.  Payload,  Technical  And  Fnel  Statns 


Time 

Aircraft  ID 

Payload 

Fuel 

Tech.  Status 

Position 

Velocity 

Performance 

degradation, 

% 

Weapon 

delivery 

capability 

Y/N 

Physical 

status 

% 

X 

Y 

Z 

Output  data 

The  output  database  generated  by  the  system  will  include  the  following  information. 
Dazta  format  must  be  acceptable  for  the  J-view  display 
Table  9.  The  Ontpnt  Database  Generated  By  The  System 


time 

Aircraft  ID 

M123 

C511 

V1341 

C511 

Y 

Z 

P 

F 

S 

X 

Y 

Z 

P 

F 

S 

... 

1205 

1210 

1215 

1220 

1225 

1230 

.... 

30 


8.  IMPLEMENTATION:  AGENTFLY  BY  GERSTNER  LABORATORY 


AGENTFLY  is  a  software  prototype  of  a  multi-agent  simulator  of  unmanned  aerial  vehieles  air 
traffie  eontrol  supporting  the  free  fight  eoneept.  All  aerial  assets  in  AGENTFLY  are  modeled  as 
asset  eontainers  hosting  multiple  intelligent  software  agents.  Eaeh  eontainer  is  responsible  for  its 
own  flight  operation.  The  operation  of  eaeh  vehiele  is  speeified  by  an  unlimited  number  of  time- 
speeifie,  geographieal  way-points.  The  operation  is  tentatively  planned  before  take-off  without 
eonsideration  of  possible  eollisions  with  other  flying  objects.  During  the  flight  performance,  the 
software  agents  hosted  by  the  asset  containers  detect  possible  collisions  and  engage  in  peer-to- 
peer  negotiation  aimed  at  sophisticated  re-planning  in  order  to  avoid  the  collisions.  The 
implemented  simulator  demonstrate  readiness  of  the  multi-agent  technology  for  distributed, 
flexible,  and  collision-free  coordination  among  heterogeneous,  autonomous  aerial  assets 
(manned  as  well  as  unmanned)  with  a  potential  to  (i)  fly  a  higher  number  of  aircrafts,  (ii) 
decrease  requirements  for  human  operators  and  (iii)  allow  a  flexible  combination  of  cooperative 
and  non-cooperative  collision  avoidance. 

AGENTFLY  is  build  on  top  of  the  ^f-globe  multi-agent  platform,  ^f-globe  provides  flexible 
middleware  supporting  seamless  interaction  among  heterogeneous  software,  hardware  and 
human  actors,  ^f-globe  outperforms  available  multi-agent  integration  toolkits  by  its  ability  to 
model  rich  environments  in  which  agents  interact,  by  its  support  of  full  code  migration  and  by  its 
support  for  scalable  experiments.  Current  AGENTFLY  implementation  provides  a  distributed 
model  of  flight  simulation  and  control,  time-constrained  way-point  flight  planning  algorithm 
avoiding  specified  no-flight  zones  and  terrain  obstacles,  flexible  collision  avoidance  architecture 
{cooperative  and  non-cooperative,  connectors  to  external  data  sources  (Landsat  images,  airports 
monitors,  no-flight  zones,  cities),  2D/3D  visualization  including  a  web-client  access  component, 
and  a  multi  access  operator  -  a  component  facilitating  real-time  control  of  selected  assets. 

The  present  work  mainly  addresses  the  problem  of  distributed  collision  avoidance  among 
autonomous  aerial  assets  using  multi-agent  technology  {each  UAA  is  represented  by  an  agent 
container  hosting  different  functional  agents.  Each  ElAA  is  controlled  by  a  single,  dedicated 
agent.  The  presented  collision  avoidance  architecture  provides  capability  to  integrate  several 
different  collision  avoidance  algorithms  that  plan  the  runtime  trajectory  of  each  individual  ElAA. 
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Such  architecture  supports  operation  of  the  group  of  eooperative  UAA  within  the  environment 
hosting  other  non-cooperative  flying  objeets  (e.g.,  eivilian  air  traffie  or  manned  aircrafts  in  the 
same  area).  Cooperative  eollision  avoidanee,  the  deeonfliction  proeess  between  two  or  more 
interaeting  and  eooperating  aerial  assets,  is  based  on  using  different  collision  metrics  and 
negotiation  protoeols.  Reeently,  the  eentralized  solution  has  been  replaeed  by  various  distributed 
approaehes  facilitating  deployment  of  e.g.,  prineipled  negotiation,  Monotonie  Coneession 
Protoeol  (MCP)  for  eollision  avoidanee  in  between  of  two  assets  or  extensions  towards  groups  of 
multiple  UAAs.  Sueh  approaeh  ean  be  slightly  altered  to  optimize  soeial  welfare  instead  of 
individual  goals  in  the  group  of  UAAs.  There  are  also  various  approaehes  based  on  the  game 
theory  available  in  the  researeh  community. 

Optimization  of  non-cooperative  eollision  avoidanee  algorithms  (deeonfliction  process  of  an 
individual  aircraft  facing  a  non-cooperative,  possibly  hostile  objeet)  allows  optimal  solving  of 
the  eollision  with  a  non-eooperative  flying  objeet  (obstaele).  These  algorithms  perform  well 
when  eoping  with  a  single  alien  flying  objeet,  but  they  eannot  be  extended  to  a  situation  with 
several  flying  objeets,  loeated  nearby.  Moreover  they  eannot  be  used  simultaneously  with  other 
eooperative  algorithms  applied  for  the  eooperative  eollisions  at  the  same  plaee.  The  researeh 
work  was  motivated  by  designing  such  a  non-cooperative  eollision  avoidance  method  that  does 
not  suffer  from  these  weaknesses. 

A  eomprehensive  deseription  of  the  AGENTFLY  and  its  operation  eould  be  found  in  the 
following  publication: 

David  Sislak,  Michal  Pechoucek,  Premysl  Volf,  Dusan  Pavlicek,  Jiri  Samek,  Vladimir 
Marik  and  Paul  Losiewicz,  “AGENTFLY:  Towards  Multi- Agent  Teehnology  in  Free 
Flight  Air  Traffie  Control”,  Whitestein  Series  in  Software  Agent  Teehnologies  and 
Autonomie  Computing,  77(100  2007  BirkhAauser  Verlag  Basel/Switzerland 
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9.  SYSTEM  TESTINGA^ALIDATION 


Testing/validation  of  the  developed  technology  was  performed  by 

1.  Establishment  of  the  realistic  characteristics  of  the  aircraft  (speeds,  payload,  available 
fuel,  etc.)  and  design  parameters  of  the  airspace  (separation  criteria) 

2.  Establishment  of  the  realistic  practices  of  interaction  between  air  traffic  controller  and 
pilots,  and  between  pilots  (such  as  usage  of  RE  communication) 

3.  Eurther  enhancement  of  interactive  graphics  and  visualization 

4.  Development  of  a  realistic  scenario  for  the  demonstration  of  the  developed  system, 
emphasizing  its  advantages  over  the  existing  practices. 

Scenario 

The  scenario  addresses  the  requirement  to  preclude  fratricide  between  members  of  a  force 
package  composed  of  heterogeneous  manned  aircraft  missions  and  surveillance  unmanned  aerial 
systems  (UAS)  in  a  target  complex  composed  of  multiple  Desired  Mean  Point  of  impacts 
(DMPI)  as  well  as  the  addressing  the  package  assembly  at  the  rendezvous  point  prior  to  ingress 
into  enemy  territory. 

The  force  package  will  be  composed  of  B52H,  P15E  and  P16C  strike  missions  with  supporting 
EA6B  Electronic  Warfare  (EW)  platforms  E15C  escort  and  E16CJ  Suppression  of  Enemy  Air 
Defense  (SEAD)  assets. 

Each  of  the  missions  within  the  package  come  from  different  departure  bases  additionally  the 
E16CJ  will  require  air  refueling  prior  to  the  rendezvous  point  If  we  consider  the  package 
rendezvous  point  to  be  the  entry  of  a  corridor  through  the  air  defense  threat  along  the  battle  edge 
and  will  be  used  by  many  packages  and  independent  missions  then  the  system  must  consider  the 
actions  of  demonstration  package  as  well  as  others  using  the  corridor  entry  point. 

The  departure  bases  are  labeled  A  thru  G  for  the  demo  package  as  shown  on  the  pictorial  The 
B52H  mission  (MSN)  1234  will  depart  from  base  A  as  a  single  ship  mission  assigned  DMPT 
INT  001,  INT002,  OCA  001  and  OCA  002.  A  second  single  ship  B52H  mission  also  departs 
from  base  A,  MSN  4321,  with  DMPI  OCA  010,  OCA  Oil  and  OCA  012  and  INT  002  as  a 
secondary  target.  There  are  two  EI5E  missions  each  composed  of  4  aircraft  and  depart  from 
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different  bases  both  missions  have  two  targets.  MSN  5678  has  DMPI  INT020  and  rNT021  and 
departs  from  A  while  MSN  6788  has  DMPI  OCA015  and  OCA016  and  departs  from  base  B.  The 
F16C  strike  mission  is  composed  of  4  mission  aircraft  with  two  targets  DMPI  INT  031  and  INT 
032  and  depart  from  Base  D  and  refuel  at  Texaco  high  prior  to  the  rendezvous  They  receive  fuel 
from  MSN  T123  a  KC135R  aircraft  that  departs  and  recovers  at  base  E.  The  SEAD  mission  is 
composed  of  two  E16CJ  aircraft  loaded  with  Home  on  Active  Radar  Missiles  (HARM)  that 
depart  from  Base  G  and  establish  orbits  in  the  package  target  area  to  provide  suppression 
coverage  for  the  fighter  mission  in  the  package.  They  also  provide  SEAD  for  package  ingress 
and  egress.  The  B52H  missions  provide  self-protection  and  also  assist  in  SEAD  coverage  of  the 
target  complex  for  the  other  package  members.  The  E15C  depart  Base  C  and  provide  escort 
coverage  for  the  package  and  once  in  the  target  complex  area  establish  Combat  Air  Patrol  (CAP) 
orbits  to  protect  the  package  once  it  breaks  up  for  target  prosecution  and  re  established  at  the 
rejoin  point  for  egress. 

NOTE  Currently  the  Air  Operations  Center  (AOC)  assigns  the  Rendezvous  point  its  time  the  air 
refueling  contact  time  and  the  time  on  targets  (usually  a  not  earlier  /not  later  time)  It  is  the 
package  commander  assigned  by  the  AOC  that  must  coordinate  the  specific  altitude/ and  mission 
associations  to  preclude  mission  fratricide  .  The  congestion  at  the  corridor  ingress  point  between 
different  packages  is  de-conflicted  by  the  airborne  C2  platform  usually  the  AWACS  but  if  the 
packages  do  not  have  knowledge  between  each  other  this  de-confliction  is  only  done  through 
time  of  entry  to  the  corridor  and  holding  orbits  may  be  required  to  get  though  the  corridor  The 
problem  get  even  more  complex  on  the  egress  corridor  as  the  entry  to  it  may  not  be  within  radar 
coverage  of  the  AWACS  and  enemy  involvement  with  the  missions /packages  make  specific  timing 
near  impossible  to  procedurally  define  .  Therefore  there  are  more  egress  corridors  available  and 
procedurally  blocks  of  time  made  available  for  missions/packages  to  egress  but  many  missions 
do  not  make  the  assignment. 

For  the  demo  we  could  have  our  package  get  to  the  entry  /rendezvous  point  at  the  same  time  as 
another  package  [our  package  has  a  problem  with  a  late  arrival  of  the  tanker  at  Texaco  (5 
minutes  late)  which  slipped  the  time  of  arrival  by  5  minutes  while  winds  aloft  make  the  other 
package  5  minutes  early. 
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Package  Two  is  composed  of  just  four  missions  a  single  B52  mission,  a  mission  of  two  F15E’s 
an  EA6B  SEAD  mission  and  Escort  E15C  in  support.  The  targets  are  not  important  but  what  is 
important  is  they  use  the  same  ingress  point  and  are  scheduled  at  the  ingress  at  only  10  minutes 
apart. 

Once  at  the  Target  Complex  (package  break  out  point)  the  attack  mission  to  go  there  separate 
ways  to  attack  their  assigned  DMPI  based  on  their  individual  mission  plans  with  the  package 
commander  attempting  to  provide  de-confliction  within  the  target  area.  The  exact  sequence  of 
targets,  unless  specified  by  a  discrete  TOT,  to  be  attacked  is  determined  by  each  mission. 

NOTE  Since  the  missions  are  planned  at  different  bases  the  specifics  of  the  route  between  each 
DMPI  are  not  known  by  each  package  participant  as  there  are  being  planned  and  route  between 
DMPI  is  not  part  of  the  ATO  nor  de-conflicted  effectively  since  missions  vary  their  path  between 
DMPIs  to  align  with  attack  target  run  in  headings  and  maneuver  to  avoid  threat  lock-  on. 

UAS  doing  Intelligence,  Surveillance,  and  Reconnaincence  (ISR)  collection  are  also  within  the 
Target  Area  along  with  the  package  however  these  assets  are  employed  either  on  preplanned 
mission  profiles  which  can  not  be  easily  altered  within  the  mission  without  canceling  the  mission 
or  are  under  the  direction  of  a  mother  ship  which  may  not  have  continuous  connectivity  with  the 
UAS.  Therefore  the  deconfliction  with  these  assets  becomes  the  premise  of  the  Package.  The 
first  UAS  asset  (predator)  is  not  continuously  guided  and  is  to  fly  at  a  medium  altitude  say 
15,000  ft  and  collect  photographic  battle  damage  data  to  allow  a  Battle  Damage  Assessment  to 
be  done.  It  is  timed  to  collect  both  pre  attack  and  post  attack  sensor  data  on  target  OCAOlO  an 
OCA015.  These  tasking  places  these  non-cooperating  assets  within  the  target  area  along  with  the 
attack  package.  A  second  UAS  mission  is  composed  of  an  active  jammer  payload  on  a  Global 
Hawk  used  to  cover  specific  frequency  ranges  not  within  the  range  of  the  EA6B  and  provide 
SEAD  for  this  package  as  well  as  other  packages  at  different  times  and  places  behind  enemy 
lines.  The  distance  places  limited  control  over  the  flight  paths  of  these  assets  from  an  EC130J  in 
orbit  on  the  friendly  side  of  the  battle  line  so  maneuvering  by  the  UAS  is  very  limited  to  avoid 
fratricide  with  the  package  and  their  altitude  coincides  with  those  used  by  the  EA6B  and  E15C 
CAP  orbits. 
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At  the  completion  of  the  attack  sequence  of  each  mission  the  package  reforms  at  a  rejoin  point 
and  can  proceeds  to  the  egress  corridor. 

NOTE  In  order  to  get  the  package  into  a  cornice  group  certain  package  members  will  be 
required  to  delay  or  speed  up  to  make  the  group  formation.  This  requires  radio  communication 
between  package  members  some  thing  that  aircrew  would  like  to  keep  to  a  minimum  as  it  gives 
away  mission  information  that  the  enemy  can  use  to  attack  the  package. 

Once  the  package  exits  the  egress  corridor  the  package  breaks  up  and  procees  back  to  either  their 
post  strike  refueling  or  recovery  base.  .In  or  demo  scenario  the  F15E  MSN5678  must  refuel  at 
Texaco  as  well  as  the  EA6B.  Plus  do  to  battle  damage  inflicted  by  small  rounds  the  E16CJ  will 
need  to  get  fuel  at  Texaco  but  does  not  have  a  pre  planned  post  refueling  and  the  system  must  de 
conflict  the  E16CJ  with  the  post  refueling  other  missions  at  Texaco. 

NOTE  this  task  is  normally  performed  by  the  AWACS  but  has  no  tools  to  work  the  sequence  to 
assure  the  Air  Refueling  Contact  Time  (ARCT)  and  receive  fuel  time  do  not  overlap  with 
preplanned  refueling.  Also  how  to  have  selected  receivers  delay/speedup  their  missions  to  make 
space  for  the  battle  damaged  fuel  needs  In  the  demo  we  could  delay  the  EA6Bto  get  a  later  ARCT 
and  speed  up  the  FI5E  MSN  5678  from  package  break  up  to  gain  an  earlier  ARCT  thereby 
making  space  for  the  EI6CJ  mission 

The  developed  scenario  has  been  successfully  implemented  in  the  developed  software  system 
clearly  demonstrating,  the  feasibility,  vitality,  and  efficiency  of  the  developed  multi-agent 
system.  Multiple  CDs  featuring  the  presentation  has  been  burned  and  distributed  to  appropriate 
agencies. 
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10.  POSSIBLE  INTERFACE  WITH  THE  EXISTING  SOFTWARE 


JASMAD  dynamically  manages  the  airspaee  volume  by  usage  and  alloeates  them  for  use  buy 
missions  but  does  not  manager  the  routes  aircraft  fly  within  the  airspaee  so  unless  positive 
eontrol  (AWACS)  is  available  it's  a  “see  and  be  seen”  route  deeonfliction.  This  is  where  our 
projeet  eomes  into  play  by  deeonfliotion  mission  routes  within  the  alloeated  airspaee  fratrieide  is 
eliminated  and  dependeney  of  positive  eontrol  is  not  neeessary.  There  are  many  seenarios  that 
would  plaee  an  AWACS  in  harms  way  for  them  to  provide  positive  eontrol  i.e.  a  SAM  threat 
espeeially  mobile.  Also  as  the  UAV  beeome  smaller  they  beeome  more  diffieult  or  near 
impossible  for  the  AWACS  to  deeonfliot.  But  we  ean!  Sinee  the  airborne  objeets  work  out  the 
deeonflietion,  positive  eontrol  is  not  required  and  using  UAV  mission  positional  data  at  the 
"mother"  ship,  UAVs  can  negotiate  mission  route  deeonfliction  especially  when  one  has  a 
problem  and  operates  as  rouge  (treat  as  a  non-eooperator).  However  we  would  benefit  from 
JASMAD's  air  volume  management  and  assure  that  deeonflietion  routes  do  not  violate  airspaee 
assignments  espeeially  air  refueling  airspaees.  Many  airlines  and  some  general  aviation  aireraft 
have  avoidanee  warning  systems  TAWS  but  they  only  warn  and  do  not  provide  a  solution  to  the 
potential  eonfiiet.  By  integrating  the  two  projeets  we  would  truly  have  the  air  over  the  eombat 
environment  managed.  With  only  JASMAD  you  manage  the  volume  not  the  entire  environment. 
The  introduction  of  waves  of  UAVs  and  the  assoeiated  fratricide  issues  will  not  be  solved  by 
managing  the  air  space  but  managing  the  routes  within  the  air  environment.  We  need  the 
dynamie  airspaee  data  JASMAD  provides  such  as  ROZ  and  Missile  Engagement  Zone  (MEZ) 
etc.  so  that  we  ean  assure  the  solution  does  not  violate  these  zones. 

Desired  scenarios 

If  a  UAV  drops  guidanee  our  system  would  eonsider  it  a  non-eooperator  and  manipulate  the 
routes  of  those  objeets  that  are  eooperating  to  preelude  fratrieide.  Sinee  the  rally  point  is  known 
we  eould  assure  vaeaney  of  that  point  at  a  safe  time  window  by  treating  the  point  as  a  ROZ  for 
the  managed  objeets.  Most  of  the  problem  with  UAV  that  are  not  responding  ean  be  handled  as 
non  eooperators  and  the  managed  objeet  routes  will  deeonfliction  from  the  non  eooperator.  In 
summary: 


37 


1)  UAV  Goes  Lost  Link  -  Our  system  treats  UAV  as  a  non-eooperating  objeet  and 
modifies  the  appropriate  aireraft’  paths  to  avoid  it. 

2)  Priority  Aireraft  Needs  Transition  Through  Airspaee  -  resolved  by  the  very  nature  of  the 
negotiation  proeess  that  is  intended  to  address  the  priorities  issue.  Controlled  UAVs  are 
expeeted  to  have  low  priority  in  the  negotiation  proeess  and  will  be  given  new  eorridors. 

3)  UAV  Engine  Failure  -  the  UAV  will  be  treated  as  a  non-eooperating  objeet. 

4)  Traeking  a  Target  -  there  is  a  provision  for  mobile  waypoints 

5)  Pop-up  Restrieted  Area  -  there  is  a  provision  for  dynamie  no-fly  zones 
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11.  RELEVANCE  TO  FAA  PLANS 


Air  Route  De-confliction  within  the  National  Airspace  System  (ARDNS) 

Purpose:  To  integrate  an  automated  air  route  de-eonfliction  eapability  as  a  segment  of  the 
Federal  Aviation  Administration  (FAA)’s  Next  Generation  Air  Transportation  System  (NexGen) 

Problem:  As  the  air  passenger  traffie  has  inereased  not  only  has  the  airport  ground  and  runway 
eongestion  beeome  a  problem  for  the  National  Air  System  (NAS,)  but  it  also  introduees  a  route 
de-eonflietion  issue  to  the  air  route  strueture  utilization  along  the  FAA  designated  routes.  This 
inereased  utilization  of  FAA  routes  has  been  further  eompounded  by  the  airline  industry’s  move 
to  smaller  airframes  for  eontinental  United  States  traffie  as  well  as  a  larger  utilization  of  regional 
jet  operations  that  earry  a  smaller  passenger  load,  but  introduee  many  more  aircraft  along  defined 
routes  into  the  NAS. 

The  increased  utilization  of  Global  Positioning  System  (GPS)  Direct  traffic  by  the  Business  and 
General  Aviation  (GA)  has  introduced  additional  potential  for  route  conflicts  to  this  saturated 
FAA  route  environment. 

Background:  The  FAA’s  NexGen  vision  introduced  programs  into  the  NAS.  Of  specific  interest 
to  route  saturation  and  conflict  identification  is  the  Automatic  Dependent  Surveillance  - 
Broadcast  (ADS-B)  program.  Additionally,  the  utilization  of  Traffic  Alert  &  Collision 
Avoidance  Systems  (TASC)  by  many  airline  and  business  aviation  users  has  increased  the  safety 
of  the  NAS.  However,  other  than  establishing  conflict  visualization  and  alerting  environment,  it 
does  not  provide  de-confliction  guidance  or  resolution  methodologies. 

The  ADS-B  periodically  transmits  operation  information  without  a  pilot/operator  input 
requirement.  The  broadcast  contains  position  and  velocity  vector  information  that  is  derived 
from  the  aircraft  GPS  or  a  Flight  Management  System  (FMS).  The  Traffic  Information  Service  - 
Broadcast  (TIS-B)  provides  the  ADS-B  equipped  aircraft  with  position  reports  from  secondary 
surveillance  radar  for  non  ADS-B  equipped  aircraft  generated  by  their  Mode  S  transponder 
broadcasts.  .This  provides  ADS-B  equipped  airframes  with  surveillance  and  identification  of  en- 
route,  terminal  and  surface  conflict  detection,  but  without  any  conflict  resolution. 
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ARDNS  was  developed,  tested  and  demonstrated  by  XXXX  under  eontraet  administered  by  the 
Air  Foree  Researeh  Laboratory  (AFRL)  -  Rome  as  an  advaneed  researeh  projeet.  The  program 
utilized  eooperating  software  agents  to  solve  a  Many  on  Many  air  route  de-eonflietion  problem. 
Upon  request,  a  Digital  Video  Disk  (DVD)  is  available  that  demonstrates  the  eapability  of 
ARDNS  and  the  software  approaeh  used  to  solving  the  route  eonflietion  issue.  When  the 
standard  de-eonflietion  FAA  proeedure  was  eompared  to  ARDNS,  ARDNS  was  found  to  be  far 
more  fuel  eonservative  and  required  mueh  less  aireraft  maneuvering  to  solve  the  eonfliet.  What 
the  eomparison  also  showed  was  that  in  intense  aireraft  environments  the  FAA  proeedure  many 
time  may  solve  the  immediate  eonfliet,  but  it  introdueed  additional  eonfliots  and,  in  faet, 
produeed  a  snow  ball  effeet  in  whieh  de-eonflietion  beeame  unmanageable  when  the  density  of 
airframes  was  introdueed  The  testing  was  performed  to  determine  the  extent  that  not  only 
eooperating  air  vehieles  sueh  as  those  with  TIS-B  and  TAGS,  but  with  non-eooperating  assets 
sueh  as  stealth  and  Remotely  Piloted  Vehieles  RPV.  In  order  to  evaluate  the  eapability  within  a 
eombat  environment  whieh  would  exeeed  the  issue  faeed  by  the  NAS,  a  test  seenario  was 
develop  with  multiple  aireraft  paekage  missions  eoming  from  multiple  departure  bases 
eonverging  on  a  target  area  with  Time  on  Target  (TOT)’s  that  overlapped.  The  ARDNS  was 
eapable  of  de-eonflieting  these  mission  paekages  as  well  as  the  RPVs  within  the  target  area.  The 
DVD  available  also  has  this  seenario  run  as  part  of  the  demonstration.  This  eombat  environment 
had  both  eooperating  agents  and  non-eooperating  agents  and  was  de-eonflieted  in  real  time. 

Currently  over  25,000  airframes  are  equipped  with  a  TAGS  II  eapability  and  by  2020  it  assumed 
that  all  aireraft  would  have  some  form  of  ADS-B  eapability  ineluding  Business  and  GA. 

ADS-B  provides  the  broadeast  informational  environment  upon  whieh  ARDNS  eould  be 
implemented.  In  faet,  it  might  be  possible  onee  ARDNS  is  part  of  the  NexGen  to  reduee  the 
separation  requirement  even  below  the  three  mile  separation  provided  by  En  Route  Automated 
Modernization  (ERDM)  eapability. 

Possible  Proposal:  It  is  proposed  to  integrate  into  the  NexGen  NAS  a  system  that  not  only  alerts 
aireraft  to  route  eonfliet,  but  provide  a  real  time  avoidanee  route  direetion.  The  de-eonflieted 
route  deflned  by  ARDNS  deals  with  a  total  relationship  with  all  other  aireraft  within  a  speeifled 
airspaee  environment  and  provides  seleetable  separations  eurrently  set  to  flve  miles.  ARDNS 
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also  attempts  to  minimize  globally  the  route  perturbations  neeessary  to  deeonfliot  the  eonverging 
airframes,  sueh  as  minimizing  the  distance  an  airframe  is  diverted  from  its  original  planned 
route,  to  minimize  climbs  and  descents  necessary  to  preclude  a  conflict  and  to  reduce  the 
necessity  to  hold  along  the  route  of  flight.  The  system  can  deal  with  non-participating  aircraft 
whether  RPV,  Stealth,  or  non  ADS-B  capable  and  incorporate  them  into  the  decision 
environment. 

The  proposed  effort  will  have  three  segments  in  which  the  ARDNS  will  be  expanded  and 
interoperated  within  the  NAS.  The  first  segment  will  allow  the  ARDNS  to  interface  with  the 
ADS-B  broadcast  protocol  and  Mode  S  transponder  code  in  order  to  develop  the  necessary  data 
for  ARDNS  to  determine  de-conflicted  routes.  The  routes  will  be  available  for  use  by  FAA  Air 
Route  Traffic  Control  Centers  (ARTCC).  This  phase  will  demonstrate  ARDNS  de-conflicted 
routes  incorporated  into  the  ARTCC  upgraded  air  traffic  display  consul.  The  design  will  allow 
the  ARDNS  defined  route  modifications  to  be  displayed  as  well  as  providing  the  ARTCC 
controller  a  source  for  traffic  directions  that  can  be  transmitted  to  affected  aircraft  via  voice 
communication. 

The  second  segment  will  address  the  data  needs  and  communications  changes  necessary  for  TIS- 
B  to  incorporate  ARDNS  directions  to  ADS-B  equipped  aircraft.  Additionally,  this  segment  will 
develop  a  demonstration  of  integration  of  this  TIS-B  enhanced  data  flow  on  a  Capstan  Multi¬ 
function  Display  (MFD)  such  as  the  GDL-90  UAT  or  GNS  500  manufactured  by  Garmin. 

The  third  segment  will  utilize  the  “breadboard”  MFD  capability  developed  in  segment  two  as  the 
bases  for  validation  demonstrations  of  ARDNS  working  in  a  realistic  ADS-B  environment. 
Multiple  test  scenarios  will  be  developed  that  contain  route  conflicts  to  stress  ARDNS  TIS-B 
instantiation.  The  test  will  require  a  minimum  of  three  environments  with  aircrew  member  as 
test  subjects  to  validate  the  actions  identified  by  ARDNS.  The  test  subjects  will  validate  that  the 
actions  proposed  are,  in  fact,  realistic  and  fiyable  by  both  airline  and  GA  aircraft.  As  part  of 
these  demonstrations,  non-ADS-B  equipped  airframes  will  be  treated  in  ARDNS  as  non¬ 
cooperating  assets. 

Given  a  successful  demonstration  of  ARDNS  capabilities,  further  expansion  of  the  capability 
could  be  further  interfaced  into  many  vendor  Flight  Management  Systems  (FMS)  and  ADS-B 
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capability.  The  ARDNS  capability  could  be  tied  to  auto  pilots  through  the  FMS  and 
automatically  establish  route  de-eonflietion  actions  once  the  FAA  has  validated  ARDNS. 

Of  the  three  segments,  segment  one  will  require  the  major  effort  and  would  require  14  months  to 
complete.  While  segment  Two  will  only  require  nine  months  to  eomplete,  there  is  almost  equal 
eost  as  interfaeing  and  ineorporating  capability  in  a  secondary  vendor’s  product  will  require  an 
agreement  with  that  vendor  and  may  require  them  to  do  some  additional  interface  work  on  the 
MFD.  Segment  Three  will  require  six  months  of  effort  to  develop  these  seenarios  and  have  them 
validated  by  both  the  test  subjects  and  the  FAA. 
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Glossary 


ACA 

Airspace  Control  Authority 

ACP 

Airspace  Control  Plan 

AF 

Air  Eorce 

AFRL 

Air  Eorce  Research  Eaboratory 

AGENTFLY 

Multi-agent  software  implementing  the  developed  system 

AOC 

Air  Operations  Center 

ARCT 

Air  Refueling  Contact  Time 

ARTCC 

Air  Route  Traffic  Control  Centers 

ASA 

Airspace  Control  Authority 

DMPI 

Desired  Mean  Point  of  Impacts 

EW 

Electronic  Warfare 

EAA 

Eederal  Aviation  Administration 

EMS 

Elight  Management  System 

GPS 

Global  Positioning  System 

GUI 

Graphical  User  Interface 

ISR 

Intelligence,  Surveillance,  and  Reconnaincence 

JASMAD 

Joint  Aerospace  Management  software 

MCP 

Monotonic  Concession  Protocol 

MED 

Capstan  Multi-function  Display 
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NAS 

National  Airspace  System 

NET 

Not  Earlier  Than 

NET 

Not  Eater  Than 

OSD 

Offiee  of  the  Seeretary  of  Defense 

SEAD 

Suppression  of  Enemy  Air  Defense 

STE 

Standard  Configuration  Eoads 

UAS 

Unmanned  Aerial  Systems 
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